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Introduction 


The  design  of  many  types  of  optimum  digital  signal  processing 
schemes  involves  an  assumed  knowledge  of  various  types  of  covariance 
matrices.  If  these  matrix  quantities  are  unknown  a priori  they  must 
be  estimated.  In  addition,  many  processor  design  criteria  require  a 
knowledge  of  inverse  covariance  matrices  for  the  purpose  of  implement- 
ing various  digital  noise  ^whitening’^  operations . Generally,  the 
method  for  obtaining  an  estimated  inverse  covariance  matrix  is  to 
estimate  the  original  matrix  and  then  invert  it  digitally.  If  the 
dimensionality  of  the  covariance  matrix  doesn't  preclude  a digital 
inversion,  then,  in  many  environments,  the  time  consumed  by  the 
inversion  process  does.  This  memorandum  derives  an  algorithm  for 
directly  estimating  the  inverse  of  a covariance  matrix.  The  estimation 
technique  used  is  that  of  multidimensional  gradient  search.  The 
method  is  ?opiicable  in  a nonstationary  noise  environment  with  the 
inverse  of  an  arbitrary  positive  definite  matrix  required  as  an 
initial  condition.^  V/  / — 

. ^ ' 

Inverse  Covariance  Matrices  and  Residues 

Consider  the  finite  dimensional  sample  vector  x.  If  this  vector 
is  obtained  from  a sample  function  of  a random  process  x,then  a 
positive  definite  covariance  matrix 
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can  be  defined.  The  notation  E{  } Indicates  the  expectation 
operation  and  a superscript  "T"  specifies  a vector  transpose.  It  is 
assumed  that  the  sample  vector  x has  zero  mean.  That  is, 
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with  the  implication  that  x is  a zero  seen  random  process.  Further- 
more , the  inverse  covariance  matrix  Q is  specified  with  the 
notation 
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The  vector 

v = Q x 

is  now  defined  by 


where 


VN  ‘iM’i  . 

If  we  further  define  the  vectors  and  X as 
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X, 


X* 

respectively,  then  an  element  in  the  ¥ vector  has  the  value 
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_ residue  of 

variance  of  rj, 


The  residue  of  the  sample  X ^ is  now  said  to  be  given  by 


rh  * xh  - X* 


where  X^  is  the  "best"  linear  mean  square  (IMS)  estimate1 of  x* 

in  terms  of  the  other  (K  - l)  terms  of  x.  To  be  more  specific. 
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where  the  regression  coefficients,  /6bo  have  been  selected 

to  minimize 

E{  r5 1 • 

Gradient  Search  Method  for  Obtaining  the  Regression  Coeff xcients 

At  the  ith  step  1 a sequence  of  observations  the  LMS  residue 

for  the  observation  )r  (i)  is 

R 

»yi>  * x„<i>  - xh(D 
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Therefore, 


L ***  * Jj** 


is  the  expected  value  of  the  elemental  change  in  the  residue  variance 

with  respect  to  the  regression  coefficient 
. The  recursive  formula  for  a modified  gradient 
search  technique  can  new  be  specified  as 


A,j(Ul)  * ♦ Kr 


■ (i)  - 2Kr 

where 

is  used  as  a "noisy"  estimate  of 

is  an  updated  estimate  of  0N  • in 
(i)  and-  the  ith  observation? 


In  the  above,  PbJ  (Ul) 
terms  of  the  old  estimate 
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In  vector  form, 


8 /§hci)  - ZKr  «yi)  X(,(i> 


where  Kir  is  a negative  scalar  constant  controlling  the  rate 
of  convergence  and  stability  for  the  estimator  vector  /9b  ( ») 

and  “ * 
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The  properties  of  this  type  of  estimator  are  given  by  Widrov  et 
al. 


Relation  Between  the  Regression  Coefficient  Vector 


Recall  that 
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which  can  also  be  written  as 


Now  define  an  augmented  regression  coefficient  vector  for  the  kth 
residue  as 


We  now  identify  with  B h by  the  relationship 
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which  for  the  ith  observation  can  be  approximated  by 


The  "normalizing"  term,  i can  easily  be  obtained  from  a 

finite  time  digital  averaging  process.  Finally,  the  estimated  inverse 
correlation  matrix  at  the  ith  step  of  an  observation  sequence  can  be 
written  as 


Conclusion 

The  algorithm  presented  in  this  memorandum  has  direct  application 
to  the  realistic  implementation  of  various  types  of  signal  processors 
based  on  an  adaptive  prewhitening  approach.  This  technique  relates 
directly  to  the  area  of  transient  signal  detection  and  can  be  extended 
to  systems  employing  spatially  distributed  receiver  elements. 3 in 
addition,  adaptive  beamforming  techniques  require  the  knowledge  of 
inverted  covariance  matrices  to  specify  an  optimal  filter  configura- 
tion. ‘ The  direct  estimation  of  inverse  spectral  covariance  matrices 
would  also  expedite  the  implementation  of  signal  processing  schemes 
which  are  frequency  domain  oriented.4  When  considered  in  the  digital 
signal  processing  context,  the  advantage  of  the  technique  presented 
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herein  is  that  it  completely  avoids  the  issue  of  digital  matrix 
inversion  and  still  allows  the  inherent  advantage  of  noise  whitening. 


7[<ytmtvrL  £.  QuhOiaj 

NORMA*  L.  OWSLEY  * 
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